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^ ^ ,. Holland House is a residential program for neelected 

and delinquent youth in Saginaw (Michigan). In 1991-94. the pfogram 
received Education Consolidation and Improvement Act Chapter J 

teaci'r f "'f' '''' purchase of materials and toward 

teacher and aide salaries for a reading skills tutorial program in a 

Hoi and House. This product review focused on the degree to which 
participants achieved the major program objectives. Ten of the 
program s 24 participants were considered in this study of reading 
achievement. Measurement with the Woodcock-Johnson TesL of ^ 
Achievem.nt indicated that 6 of the 10 students evidenced gains in 
both basic and advanced reading, 2 gained in 1 are,, and lost in the 
other and only 1 demonstrated losses in both ar.as . These resul s 
support the contention that the program achieved its obj ct v s n 

rec!f!: th'rrth' ^^-^ ^^^^-^^ performanJe c;lt:r: n 

he i ch '"'"'/V^y r ' ^" aggregate over and above 

the Michigan standard gain of three normal curve equivalents. 

Recommendations are offered for program improvement. Four appendixes 

presen a weekly evaluation form and information about disbu sem " 
ea her inservice attendance, and reading gains. (Contains three 

tables and two references.) (SLD) 
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INTHDDOCTION 



Holland House is a residential program designed for neglected and delin- 
quent youths. During 1993-94, the program received Education Consolidation 
and Lnprovement Act (ETIA) Chapter 1 funding. This funding was used toward 
the purchase of materials for a reading skills tutorial program and to 
reimburse the program for salary paid to a teacher and a pan— time aide. As 
well, the supervisor and two staff members attended Chapter 1 sponsored 
inservice sessions. 

The majority of the program's instruction occurred at Nouvel Central 
Catholic High School located in Saginaw Township. During the day, students 
attended classes in a classroom specifically set aside for the use of this 
program. Some students, depending upon their needs and abilities, also took 
classes in the regular Nouvel program. The remainder of the instruction 
occurred at the Holland House group hone (614 East Holland Avenue, Saginaw, 
Michigan). During the evening, students attended additional sessions of study 
and instruction which varied from one to two hours in length. 

Student progress was monitored on weekly evaluation sheets. Each student 
received a weekly description of his behavior and participation and a letter 
grade reflecting his academic performance. Appendix A contains a blank copy 
of this evaluation form. 

The remainder of the text of this report will present the procedures and 
findings of the 1993-94 product review. The program's 1993-94 Chapter 1 
expenditures are detailed in Appendix B and a list of Chapter 1 inservice 
sessions attended by the staff is in Appendix C. 



HOCEDUKES 



A product evaluation focuses on the degree to which participants achieve 
the major objectives of the program. This evaluation consisted of comparirg 
students' entry and exit normal curve equivalent (NCE) scores on the Wbodcock- 
Johnson Tests of Achieve ment - Standard Battery (WJ-R-ACH) Form A agairst the 
success criterion (specifically, an average gain in excess of three NCE's in 
basic and advanced reading scores). This test is not on the Michigan 
Department of Education's (MDOE) list of approved tests is it the test 

specified in the funding grant; however, it was ratiornlly nomed 1986-19S8 
(Woodcock and Mather, 1989) arx3, accordir^ to the program supervisor,, is 
widely used in the Michigan Boysville Program. 

PAKTICIPAWrS 

Curing 1993-94, 24 students were served by the program. ^ of these, 14 
(58.3%) were Black, 8 (33.3%) were White, and 2 (8.3%) were Hispanic. Ihey 
ranged in age from 13 to 17 years. 

Ten of the 24 (41.7%) program participants were cor^idered in this study. 
Of the other 14, 9 (37.5%) entered the program with less than five months 
remaining in the school year, and 5 (20.8%) left the program without takii^ a 
post-test . 

MEIHOD 

in late August, 1993 (or upon entry to the prc^ram) , the students were 
pre-tested and in May, 1994 (or just before exiting the prc^ram) , the students 
were post- tested using the readirg subtests of the WJ-R-ACH. 



there we^e at ^J^?T^ T ^^"if P^^^ throughout the year, 

released from and admitted to the program over the course of the year. 
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FIJDIN3S 



Student performance was examined to determine whether the program attain- 
ed its standards 

imrajwEaar op the stmi^rd 

The performance criterion specified in the grant was that students would, 
in aggregate, evidence gains over and above the Michigan standard (more than 
three NCE's) in basic and advanced readirq skills. Operationally, this was 
defirBd as growth in NCE units on, respectively, the broad reading and reading 
oortprehension subtests of the WJ-R-ACH, 

Table 1, below, presents the average gains, in NCE's, in basic and 
advanced reading evidenced by the students during 1993-94. Table D-1, in 
.^ippenJix D, presents the actual pre- and post-test roCE scores, and change, for 
each of the 11 students considered in the study. 

Table 1 



Attainnent of the Perfonnanoe Standard^ 





Mean gain 


Standard 


Reading skill 


in NCE's 


attained 


Broad reading (basic) 


3,6 


Yes 


Passage comprehension (advanced) 


8.6 


Yes 



Kbte. N=10 students. 



Standard: Post-test NCE scores will on average exceed three NCE's 
greater than pre-test scares. 



ERIC ' H 



Based upon the data contained in Table 1, it can be concluded that the 
program attained its objective in both advanced ard basic reading ^ 

Also from Table I>-1, one can find that 6 (60*0%) of the 10 students 
evidenced gains in both basic and advanced reading, 1 (10*0%) experienced a 
gain in basic but a loss in advanced reading, and 2 (20*0%) experienced a loss 
in basic but a gain in advanced readirg and 1 (10*0%) demonstrated losses in 
both reading areas. 
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SUMMARY 



During 1993-94 f the Holland House program provided classroom and tutorial 
instruction as well as guidance and counseling to 24 youths. 

The program received Chapter 1 funding to purchase instructional 
materials and help defray the salaries of a teacher and a part-time aide for a 
tutorial reading program. 

The aim of this evaluation review was to examine the amount of growth in 
reading skills evidenced by the participants. An average gain in excess of 
three normal curve equivalents (NCE) units in both basic and advanced skills 
as measured by the WJ-R-ACH w^s set as a standard for the program. This 
standard was attained for advanced and basic reading. 

Beginning on the next page, recommendations will be offered. 
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RBCX»MEM»TIONS 



Prior to offering reoommerdations; it should be noted that the program is 
attainirg its primary goals. It is providirg a remedial program to delinquent 
youth/ only one aim of which is to irrprove those students' reading skills. 
These recannenaations are presented with the intention of enhancirg an already 
effective program's approach to that one aim. 

It should also be noted that the recormendations below are not meant to 
be exhaustive; the enhancements they suggest may be attairable through other 
means. The supervisor and staff may want to consider what other means are 
available and ' should seek assistance from the district's Coirpensatory 
Education and/or Evaluation, Testirg, and Research departments. 



• The staff should continue, where possible, to attend 
inservices offered through the Sagiraw Public Schools' 
Instructioral and Staff Development Center. Further, 
they should maintain dialogue with local Chapter 1 
personnel. Both of these vehicles provide a prof- 
itable interchange of ideas. 

• The supervisor should try to determine the reason for 
the success in student performance (whether it was 
due mostly to individual differences, program priori- 
ties [directly related to student need] , instructioral 
changes, or student attitude during the test) and what 
could be done to maintain gains - program wide - in both 
basic and advanced reading. 

• Student performance should be assessed by the test 
specified on the funding grant (e.g., the Woodcock 
Reading Mastery Tests - Revised, 1987 ) . 
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APPENDIX B 



DISBURSEMENT REXX)RD OF CHAPTER 1 FUNDS FOR 
THE HOLLAND EKXJSE PROGRAM DURING 1993-94. 



ITEM POST 



Capital/Supplies ^ 7,787.95 
Salary Reinibursement 1,020.00 
Conferences 603.00 



2 

Total S)qpenditure $ 9,410.95 



These supplies included: 

• Supplemental and summer school textixDoks 

• Resource iDooks (e.g., encyclopedia, dictionaries) 

• Magazines and newspapers 

• Maps 

• Paperback books 

• Lab equipment 

• Computer supplies 

• Office furniture and supplies 

• Testing materials. 

• Classroom supplies (e.g., pencils, pens, paper, folders, notebooks, 
and calculators) . 



The total allocation for the program was $13,982.00, which left $4,571.05 
unspent as of the time this report was written. Plans for the expenditure 
of these funds during Summer, 1994, have already been made. 



16 



APPENDIX C 



Table C-1 

Chapter 1 Inservice Attendance 



Staff Attending 

Inservice Session ABC Count 



How to Achieve Maximum Success in the Classroom 


X 


X 


X 


3 


Chapter 1 Update 


X 






1 


Vfliole Language 


X 






1 


Understanding and Reading 




X 




1 


Succeeding with Difficult Students 




X 


X 


2 


Playground Emergencies 




X 




1 


Tourette Syndrone 




X 




1 


Vision Oculomotor Dysfunction 




X 




1 


Higher Order Thinking Skills 






X 


1 


Math Number Sense 






X 


1 


Building Childrens Self-Esteem 






X 


1 


Math Basics 






X 


1 


Invitation to Vfliole Language 






X 


1 


Secondary Content Literacy 






X 


1 


Exploring Writing Strategies Are Successful 






X 


1 


With Diverse Learners 










.\l rocentric-Multicultural Literature for Children 






X 


1 


Teaching for Independent Use of Cues 






X 


1 


View from the Mesa 






X 


1 


Cooperative Discipline: A Positive Management 






X 


1 


Approach for Children with Diverse Needs 










Literacy and the At-Risk Learner 






X 


1 


Creating Active Learners in Social Studies Classes 






X 


1 
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APPEJTOIX D 



Table 

jy-l Broad Reading and Passage Canprehension NCE Gains 





Broad reading (Basic) 




comprehension (Advanced) 




Pre 


Post Gain 


Pre 


Post Gain 


A 


46 


46 


0 


49 


47 


2 


B 


44 


52 


8 


50 


75 


25 


C 


13 


23 


iU 


28 


37 


9 


D 


1 


7 


6 


1 


15 


14 


E 


7 


19 


12 


19 


32 


13 


F 


62 


54 


8 


59 


58 


1 


G 


54 


52 


2 


50 


57 


7 


H 


17 


25 


8 


28 


34 


6 


I 


41 


46 


5 


34 


44 


10 


J 


47 


44 


3 


54 


59 


5 


N 


33,2 36,8 


3,6 


37,2 45,8 


8,6 


(SD) 


(20,5) (15,9) 


(6,2) 


(17,5) (16,3) 


(7,4) 



Note. Maximum score = 99. N=10 students. 
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